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ABSTRACT 


The documentation of a complete proto-compiler consisting of a 
syntax checker and an 0S/360 operating system interface for the 
IBM System/360 computers is presented. The system constitutes the 
foundation of a translator writing system based on the language PL360 
and on the SLR(k) parsing algorithm. PL360 provides all the facilities 
of a symbolic machine language but displays an ALGOL-like structure 
for improved readability and programming ease. SLR(k) parsers have 
been shown to be superior to those constructed using precedence 
techniques with regard to the class of acceptable grammars and speed 


of operation. 
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I. INTRODUCTION 


The computer solution to a problem is usually divided into two 
phases: translation of the source language and execution of the 
translated program. The translation process is a mapping of sentences 
from a source language to a target language while maintaining semantic 
equivalence. The target language is usually a sequence of machine 
instructions which directs the machine in the solution of the problem. 
The task of writing a program (compiler, assembler) to perform this 
translation process is generally long and difficult; thus, it has been 
the concern of researchers to automate as much of the compiler writer's 
task as possible through the use of translator writing systems (TWSs). 

A TWS automates such functions as scanning text, analyzing syntax, 
synthesizing code, and interacting with an operating system in a 
general manner thereby allowing the compiler writer to concentrate on 
items unique to his translator. 

The objective of the research reported herein was to develop a TWS 
based upon the language PL360 [Ref. 1] and to implement the system on 
“the IBM 360/67 computer at the W. R. Church Computer Center, Naval 
Postgraduate School. This goal was not completely achieved since the 
system lacks a PL360 program to analyze a grammar and produce corres- 
ponding tables required by the SLR(1) [Ref. 2] parsing algorithm. 

However, the basis of a TWS has been developed consisting of a syntax 
checker upon which the compiler writer may build, and an 0S/360 


operating system interface for the IBM System/360. 





The next section of this report contains a review of two translator 
writing systems and is intended to provide the reader with some helpful 
background information. A description of the PL360 compiler generator 


is presented in the final section. 





Il. BACKGROUND 


This section explores some concepts and principles of TWSs by 
reviewing two research efforts. An excellent paper by Feldman and 
Gries [Ref. 3] contains a critical survey many such efforts. The 
first system reported herein is that of O'Neil [Ref. 4] and the second 
is that of McKeeman, et al. [Ref. 5]. These were chosen because they 
are representative of the two general classes of parsing algorithms: 


goal oriented or top-down methods and bottom-up methods. 


A. THE META PI SYSTEM 
The META PI system is generally based upon a model known as META II 
developed by Schorre [Ref. 6] and his associates at UCLA. It is a 
Ssyntax-directed symbol processor which states the parsing and trans- 
lation functions for a language in a set of BNF-like (Backus-Naur Form) 
rules. These rules include semantic operations within the syntax 
Structure describing the language. The basic parsing algorithm is 
simple top-down, left-to-right, with backup. 
META PI statements contain three types of elements: 
1. Syntactic elements which are used to generate 
the syntax checker of the user's compiler. 
2. Semantic elements which affect code synthesis in 
the user's compiler. 
3. META syntactic elements which enable the user's 
compiler to resolve possible ambiguities. 


The user produces a compiler by combining these three elements into 


input statements. 





The general form for a statement is: 
LABEL := expression 
The identifier to the left of the symbol pair ":="' is defined by the 
right-hand expression. For example, the ieeaion of IDENT is written: 
IDENT := LETTERS (LETTER/DIGIT) 

The operator "S$" is a prefix iteration operator and indicates that what- 
ever follows may be repeated any number of times (possibly zero). The 
META PI symbol "/" and the BNF symbol "|" are equivalent. Hence, the 
above rule would be interpreted as: “an identifier is a letter followed 
by any number of letters or digits." Note by the above example that 


unlike BNF, nonterminal symbols are not enclosed in broken brackets. 


ot tt off 
e ee 


Terminal symbols are preceded and followed by » and a indicates 
that a system symbol follows. 

The elements that comprise META PI statements are explained in 
detail in Ref. 4; however, their use is illustrated by two examples 
below. 

EXAMPLE 1: 
If a user wished to permit multiple FORTRAN statements on one line, 
he might issue the following command: 
USERCC := STAT.NOP(.CLAMP) SSTAT 
where STAT identifies the definition of a FORTRAN statement. The 
semantic command ".NOP(...)'' produces the effect of the semantic operation 
",CLAMP"' and has no effect on the compiler. It is included only to 
complete the general form of a semantic function, which is 
semantic-command (semantic-operations) 


The operation '"'.CLAMP" directs the compiler to suppress backup in the 


event of an exit to an error routine. Recall that "SSTAT" allows any 


number of statements to follow. 





EXAMPLE 2: : 

To define a read statement equivalent to the BNF format 

<read statement> ::= READ <read list> 
the user might issue the following META PI command: 
READ 7="- READ: RED’ SC; 2° RED es; ; 
where RID identifies the definition of a read-list element. Note that 
the word "READ", the comma, and the semi-colon will be recognized as 
terminal symbols because they are preceded and followed by the colon 
mark. A syntactically correct read statement could thus be 
READ <read-list element> , <read-list element> ; 

META PI generates an encoding of the rule in the user's compiler 
and references it by the unique identifier. When recognition of the 
identifier is established as a goal at compile time, the generated code 
is called and one of three condition codes is returned: 

1. True, the scanned input satisfies the rule. 

2. False, it does not. 

3. Syntax error. 

These three conditions describe the state of the top-down parsing 
algorithm at any given time. For example, assume the assignment 
statement 

DOII = 1.5 
is the next input to be scanned. Note the similarity to the DO state- 
ment 

bo1ilt.e-1,5 
which differs by the occurrence of a comma instead of a decimal point. 
Assume also that the current goal of the parser is STAT (statement) 


and that all statements are either DO statements or assignment 





Statements. If the parser first attempts to satisfy the subgoal of a DO 
statement, the condition code "false" is returned when the symbol "." 
is encountered. The subgoal of an assignment statement is then es- 
tablished and satisfied when the code "true" is returned. If the final 
parse attempt had also failed, the code "syntax error" would have been 
returned indicating that STAT could not be recognized. 
Each recognition of an identifier causes a routine in the compiler 
to be executed and, in most cases, machine code to be generated. 
Compilers produced by META PI are generally considered to be some- 
what inefficient but have the advantages of ease of implementation 


and the ability to handle a large class of languages. 


B. THE XPL COMPILER GENERATOR SYSTEM 

In this section, the principles of McKeeman's compiler generator 
are discussed, concentrating on the parsing algorithm component. The 
system is explained in detail in Ref. 5, which is an excellant intro- 
duction to the construction of TWSs and a user's manual for the XPL 
programming language. 

The parsing algorithm is a particular type of bottom-up parser. 
The distinguishing feature of the algorithm is that it does not use 
state-of-the-parse information, as top-down methods do; rather, it 
involves examining the canonical sentential form (each string in a 
canonical parse) to determine what unique parse step is applicable and 
then performs a substitution. 

McKeeman's recognizer is a modification of Wirth's [Ref. 7] pre- 
cedence concept. A wider class of grammars is acceptable since they 
are not restricted to eMnpie precedence. The mixed-strategy oreces 


dence (MSP) algorithm uses a symbol pair predicate in its stacking 





decision function and reverts to a bounded context of degree (2,1) 
predicate only in the case of a conflict. The production selection 
function is bounded context of degree (1,1); hence, the parser is called 
MSP (2,131,1). Since most triples of symbols cannot occur in a canonical 
ese, two symbols usually suffice to determine whether to accept the 
next symbol in the text and place it on the parse stack or to apply 

a parse step and reduce the top few symbols on the parse stack. Also, 
the number of different triples is so large (over 10,000 for XPL) that 
memory is wasted by tabulating all of them. Thus, McKeeman's concept of 
MSP is a compromise using Wirth's two-argument precedences whenever 
possible and switching to triples only when necessary. 

The three major programs of the XPL compiler generator system are 
the syntax analyzer, which builds the tables required by the MSP 
algorithm; the proto-compiler with which the user can produce a compiler; 
- and the XPL compiler which translates XPL to System/360 machine code. 

The syntax analyzer is a program which accepts the BNF definition 
of a grammar, determines whether the grammar is, in fact, MSP (2,13;1,1), 
constructs parsing decision tables, and punches Bone cables on cards 
in the form of XPL declarations. 

The proto-compiler uses the cards produced by the analyzer and 
functions as a syntax checker. The user may build on the proto-compiler 
by rewriting the code synthesis routine to implement the semantics of 
the new language to be compiled, and by altering the text-scanning 
routine to correctly interpret the terminal symbols of the new language. 
When this is done, each reduction in the syntax analysis causes the 
code synthesis procedure to be invoked. This procedure is provided 
the applicable production number so that the appropriate machine code 


can be generated. 
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The XPL compiler generator system allows the user to construct com- 
pilers for languages described by relatively small grammars with a 


minimum of effort. 


ee 


III. DESCRIPTION OF THE PL360 COMPILER GENERATOR 


It was decided to design a compiler generator system based on 
McKeeman's concepts but with two fundamental differences: 

1. The system was to be written in the language PL360 to improve 
the performance of resulting compilers and to provide a more 
compatible interface to standard IBM software. 

2. The parsing algorithm would be DeRemer's SLR(1) [Ref. 2] to 

increase the class of acceptable grammars and to improve computation 


time. 


Pee FL 360 

In 1968, Wirth published a formal description of PL360 [Ref. 1], a 
language designed specifically for the IBM System/360. A year later, 
escompiler written by Wirth, J. W. Wells, Jr., and E. Satterthwaite, Jig: 
was made available through the IBM Contributed Program Library [Ref. 8]. 
Several amendments to the original language definition were included 
with the documentation issued with the compiler. Further extentions 
and modifications to the language have recently been carried out, most 
notably by M. A. Malcolm [Ref. 9]. Malcolm's PL360 manual has incor- 
porated all changes to the language Renin neion and compiler description 
made to date. 

PL360 is a language that provides all the facilities provided by 
System/360 Assembler Language yet exhibits an ALGOL-like syntax. It 
was designed to improve the readability of programs written to take 


advantage of specific capabilities and limitations of the System/360. 


eZ 


Such programs are defined by a set of BNF rules and semantic explana- 
tions given in Ref. 9. 
Some characteristics of the language are illustrated by means of 
examples. 
EXAMPLE 1: 
PROCEDURE NEXTCHAR(R3) ; 
BEGIN IF R5 < 71 THEN R5 := R5 + 1 ELSE 
BEGIN RO := @CARD; READ; RS := 0; 
END; 
IC(RO,CARD(R5)) ; 
END 
This procedure would be used to insert the next character of the input 
buffer into register RO (bits 24-31). Register R3 contains the return 
address from this procedure so it is important not to alter its con- 
tents. Assume the identifier "CARD' has been previously declared to 
be a byte array of length 80. If register R5 (the column pointer) is 
not less than 71, then a new card is read by setting register RO to 
the address of "CARD" and calling procedure READ. The column pointer 
is then initialized to zero and the first character of "CARD" is in- 
serted into RO. If, however, R5 is less than 71, it is simply incre- 
mented and used as the new index. 
EXAMPLE 2: 
BEGIN INTEGER BUCKET; 
IF FLAG THEN 
BEGIN BUCKET *= RO; RO := R1; R1 := R2; 
R2 := BUCKET; 


END ELSE 


Ike 


BEGIN BUCKET := R2; R2 := R13; R1 := RO; 
RO := BUCKET; 
END; 
RESET (FLAG) ; 
END 
This block exchanges the contents of registers RO, Rl, and R2 in a way 
which depends on the value of FLAG (assume FLAG has been declared to be 
a byte variable). If FLAG is true (i.e. if FLAG = #FF) then the first 
statement is executed and the contents of the reqiecene are shifted 
left with R2 being assigned the value of RO. If FLAG is not true then 
the second statement is executed. The integer variable 'BUCKET" is 
used as a temporary storage location. Upon completion of the IF 
Statement, FLAG is set to #00 by a function call on RESET. 
Note the block structure of the language with its attendent scope 


of variables. Note also the register manipulations and symbolic machine 


instructions (IC and RESET) which characterize assembler language. 


B. THE PARSING ALGORITHM 

DeRemer defines a class of context-free grammars called "Simple 
LR(k)" or SLR(k) which includes the simple precedence grammars as 
proper subsets. A method for constructing parsers for SLR(k) grammars 
is shown in Ref. 2; they have been implemented by DeRemer and have 
proven to be superior to corresponding MSP parsers both in the speed 
of parser construction and in the size and speed of the resulting 
parsers. 

For the stacking decision, the MSP algorithm uses at most the top 
two symbols on the parse stack and the next symbol from the input text. 


SLR(k) parsers make the stacking decision based on all the symbols in 
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the parse stack plus k more from the input text. This is accomplished 
by restructuring the stack and saving state-of-the-parse information. 
The operation of the parser will be illustrated by example. 


Consider a sample grammar: 


The finite state machine represented in Fig. 1 parses sentences 
generated by the sample grammar. The algorithm is started in state 

O and passes through a series of states until reaching a state with 

no successor. The indicated rule is applied and the parser is restarted 
in state 0. The algorithm terminates upon reaching state 2 and an end- 
of-file mark is encountered. For example, when in state 1 and the syn- 


bol "x" is encountered, apply the reduction T>x and restart; when in 





2 ees BT 


a 
pe Sto 
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Fig. 1 Finite State Machine for the Sample Grammar 


state 3 and the symbol "(" is encountered, stack the symbol and enter 
State 4. 
The SLR(1) parsing algorithm has been implemented in one of the 


procedures of the proto-compiler. 


se) 





C. THE PROTO-COMPILER 

The program called "PROTOCOM" forms the basis of the PL360 compiler 
generator system (see Appendix A for the program listing). It is 
patterned after McKeeman's proto- compiler and has the same function and 
basic structure. 

PROTOCOM uses SLR(1) parsing tables obtained by manually translating 
the XPL declarations produced by DeRemer's yatax analyzer [Ref. 10] 
into equivalent PL360 declarations. The output from DeRemer's program 
is iisted in Appendix B. The translated tables ae referenced by the 
algorithm contained in procedure ANALYZE to implement the finite state 
machine of a simple grammar. 

ANALYZE calls on procedure PUSHANDREAD or procedure SYNTHESIZE 
based on a decision to stack the current symbol and read a new one 
or to make a reduction and perform the required semantic operations. 
Since code synthesis is not a function Of PROTOCOM, SYNTHESIZE exists 
only to maintain flow of control and indicate that its presence would 
be required in a full-scale compiler. 

Procedure SCAN, called from either PUSHANDREAD or ANALYZE, inter- 
prets characters in the card buffer. Upon reaching the end of a card 
image, a call on procedure GETCARD causes a new card to be read. 

The only other major procedure is ERROR which is called from a 
number of other routines; it accounts for syntax errors and prints 


diagnostic messages. 


D. OPERATING SYSTEM INTERFACE 
Assuming that the object program resulting from a compilation of 
PROTOCOM is to be used as a compiler, the problem of communicating 


with an operating system arises. Since PL360 object programs do not 
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communicate directly with an operating system, an interface program 
must be separately assembled and merged with the compiler by the 
linkage editor. 

The existing system uses such an interface (called 'PLIO") in the 
0S/360 operating system environment (see Appendix C for the program 
listing). It has entry points to pate subroutines which facilitate 
input and output operations. The names and specifications of these 
subroutines are listed below. 

1. READ: transmission of a card image record to PROTOCOM: RO 
contains the address of an 80-byte buffer into which the re- 
cord is to be moved; set condition code to 2 if end-of-file 

_is encountered, otherwise set to 0. 

2. WRITE: transmission of a line image record from PROTOCOM; RO 
contains the address of a 132-byte output record. 

3. PAGE: insert the USASI control character "1" into the first 
position of the print buffer. 

4. PUNCH: transmission of a card image from PROTOCOM; RO contains 
the address of an 80-byte output record. 

Two additional subroutines would be required in PLIO if PROTOCOM 

is to be built into a compiler: a system initialization subroutine 

to decode any required parameter list, open required data sets, obtain 
free storage, and supply system identification. A system termination 
subroutine is also necessary to release free storage and close re- 
quired data sets. These enable the operating system to properly iden- 
tify and store the machine code produce by the compiler. 

PROTOCOM uses the data sets described below and identified by their 


DDNAMEs. All data sets are sequential with fixed block format. 
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1. SYSIN: This data set constitutes the input and consists of 
one or more source programs. The logical record length is 80 
bytes. 

2. SYSOUT: This data set contains the compiler output 

listing including diagnostic messages. The logical record 
length is 133 bytes. 

3. SYSPUNCH: This data set contains object code (if any) produced 

by the compiler. The logical record length is 80 bytes. 

At least one additional data set would be required in the event 
PROTOCOM is built into a compiler: a direct access data set to contain 
object code and closed with a disposition of REREAD for further pro- 
cessing, such as linkage editing. | 

The job control language required to compile, linkage edit, and 
execute a typical PL360 program is listed in Appendix D. It is assumed 
that the file with DSNAME S0938.PLLIB contains the PL360 compiler and 
its required interface routines. 

The author believes PROTOCOM to be free of errors. The program, 
however, has not been subjected to rigorous debugging. Also, in the 
per est of readability and the lack of a pressing need, no attempt 


has been made to write the most efficient proto-compiler possible. 
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IV. CONCLUSIONS 


It is concluded that the PL360 language is well suited to form 
the basis of a compiler generator system which is to be implemented 
on the IBM System/360. It is fairly successful in providing a tool 
which is superior to assembly code ie in meeting the objectives of 
readability and writability. The language is not as easy to uSe as 
some other high-level compiler-writing languages, such as XPL. The 
execution speed, however, indicates it to be the superior language in 
systems and production programming applications. 

It was stated earlier that the compiler generator system described 
in this paper has not been fully ioienenees in that it lacks a syntax 
analyzer. The method of manually translating XPL declarations produced 
by DeRemer's program into equivalent PL360 declarations is conceptually 
simple but tedious for interesting grammars. It would not be a diffi- 
cult task to alter DeRemer's program to have it produce PL360 de- 
clarations directly. It is recommended that an SLR(1) ores written 


in PL360 be added to the system to provide a solution to this problem. 
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COMMENT 


#OOOIS; 


_#0002S;, 
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THE DPDA HAS 9 REDUCE STATES; 
#HOOX, 


#OOX, 


? 


COMMENT THE DPDA HAS 8 READ STATES; 
ARRAY 10 BYTE NUM 


COMMENT 





ARRAY 10 SHORT INTEGER REDUCESUCC = (#0000S, #0002S, #03 
#0300S, #0500S, #0500S, #0501S, #0501S, #0501S, #0700 


COMMENT THE DPDA HAS 3 LOOK-AHEAD STATES; 

ARRAY 3 BYTE LASYMNUM = (#00X, #00X, #00X); 

ARRAY 3 SHORT INTEGER SUCCSTATE (#0201S, #0202S, #020358); 
ARRAY 3 SHORT INTEGER FAILSTATE (#0003S, #0004S, #000758); 


ARRAY 3 REAL LATABLE = ( 
#40000000R COMMENT <G>35, 
ENT <E>3, 
| <3) 


#60000000R COMM 
#60000000R COMME 


COMMENT THE DPDA HAS 2 LOOK-BACK STATES; 

ARRAY 2 BYTE LBSTART = (#00X, #02X);5 

ARRAY 2 BYTE LBNUM = (#01X, #01X)3 

ARRAY 4 SHORT INTEGER LBSTATE = (#0101S, #0000S, #0106S, 
#0000S) 3; 

ARRAY 4 SHORT INTEGER RESUMESTATE = (#0301S, #0302S, #0205S, 
#0204S) ; 

COMMENT THE SYMBOLS ACCESSING THE STATESs$ 


ARRAY 8 BYTE SYMBEFOREREAD = (#OOX, #01X, #07X,y #O8X, #O9X, 
#O2X, #03X, #09X); 


ARRAY 3 BYTE SYMBEFORELA = (#08X, #09X, #09X); 
COMMENT END OF CARDS PUNCHED BY THE SLR(1) SYNTAX ANALYZERS 


INTEGER RESERVEDLIMIT = QO; 
COMMENT SHOU 


LONG REAL V8 SYN V(8);5 EL DSALWAYS BE sa. 

ARRAY 30 BYTE ALPHABET = ("ABCDEFGHI JKLMNOPQRSTUVWXYZ_$a#") 3 

COMMENT DECLARATIONS FOR THE SCANNER: 
TOKEN 1S THE INDEX INTO THE yaaa. VQ) OF THE 
LAST SYMBOL SCANNED, CP IS THE POINTER TO THE LAST 
CHARACTER SCANNED IN THE CARD “MAGE, BCD 13 Uae 
LAST SYMBOL SCANNED; 

COMMENT NUMBERVALUE CONTAINS THE NUMERIC VALUE OF THE LAST 
CONSTANT SCANNED; 

INTEGER TOKEN = 1, PRODNUM, NUMBERVALUE, SP3 

MHtEGER REGISTER CP SYN R85 

LONG REAL BCD; 

INTEGER BCDHIGH SYN BCD(0O); 

INTEGER BCDLOW SYN BCD(4);5 

ARRAY 80 BYTE CBUF; COMMENT CARD BUFFER; 

COMMENT  EXITFLAG IS USED TO INDICATE END OF COMPILING; 

BYTE LISTFLAG, ENDIT, EXITFELAG = #00X;3 

COMMENT XR IS THE ERROR ROUTINE PARAMETER REGISTERS 

MYrEGER REGISTER XR SYN R5;5 

SHORT INTEGER ERRCOUNT = OS, CARDCOUNT = OS; 

INTEGER EOFILE, NUMBER, IDENT, DIVIDE; 

LONG REAL CONWORK; COMMENT USED TO CONVERT TO DECIMAL ; 

BYTE TRUE = #FEX, FALSE = #00X; 

SHORT INTEGER PREVIOUSERROR, ERRLIMIT = 505; 

ARRAY 132 BYTE BLANK = 1320" "); 

ARRAY 132 BYTE WBUF; COMMENT WRITE BUFFERS 

INTEGER MASK = #0Q0000FF3 

INTEGER MASK? = #00000007; 

INTEGER MASKFFFF = #0000FFFF; 

INTEGER BLANKMASK = #404040403 

INTEGER MASK1 = #00000001; 
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READ; 
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BEGIN 
F67.:= VCR; 
IF F6¢ = BCD THEN 
BEGIN 
Rl := R1 SHR ; 
TOKEN = R13; GOTO L13 
END $ 
9 
COMMENT MUST BE <IDENT>; 
Rl := IDENT; TOKEN <:= R13 
GOTO L1; 
END ELSE COMMENT CLETTER OR DIGIT; 
BEGIN 
R2 := S2 + 13 S2 := R235 
IF R2 <= 4 THEN 
BEGIN 
R4 := R4 — R43 BCDHIGH <:= R43 
IC(R4,CBUF(CP))3 
R4&4 := R4 AND MASK; 
R5 := BCDLOW SHLL 8 OR R43 
BCDLOW := R53 
END ELSE 
BEGIN 
IC(R4,CBUF(CP));3 
R4 := R4 AND MASK3 
R5 := BCDHIGH SHLL 8 OR R43 
BCDHIGH := R5; 
END; 
END; 
END; 
COMMENT END OF CARD3 
GETCARD;3 
END; 
END; 
COMMENT CASE 6: DIGIT; 
BEGIN 
Rl := NUMBER; TOKEN := R13 Rl := Rl — R13 
ae TRUE DO COMMENT UNTIL GOTO L13 
FOR CP := CP STEP 1 UNTIL TEXTLIMIT DO 
BEGIN 
IC(R1;CBUF(CP) )3 
IF Rl < 240 THEN GOTO Ll13 
onan >= NUMBERVALUE * 10 + Rl ~ 240; 
GETCARD; 
END; 
END 3 
COMMENT CASE 7: 7/3 
BEGIN 
Ri s= DIVIDE; TOKEN := Rl; CP := CP + 13 
GOTO Ll; 
END; 
oon CASE 8: SPECIAL CHARACTERS 
Rl <= RL SHLL 23 R2 := TXC(RL1L);5 
ae ae s= R23; CP := CP + 13 GOTO L1L3 
Set CASE 9: END OF FILE MARK, "*.%35 
Stes s= 13 TOKEN 2="Ri- Goro Li; 
END; COMMENT END OF CASE ON CHARTYPE;3 
CP := CP + 1; 
END ; 
END; 
J R4 3:= SAVE4;3 
END; 
PROCEDURE PRINTIME(R6)3 NULL3 
COMMENT THIS PROCEDURE SHOULD GET TIME OF DAY AND INSERT 
INTO WBUF(18)-WBUF( 22), FORMAT "13:37"; 
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f_ TODAY'S DATE CAND INSERT 
ORMAT "72.153"; 
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